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process. Results may be used by schools as benchmarks in evaluating ttjeir own 
results. This report is based on data from 165 law schools that participated 
in the correlation studies in both years. As previous reports have shown, 
results indicate that the LSAT alone tends to be a better predictor of law 
school performance than is the undergraduate grade point average (UGPA) 
alone. The combination of LSAT and UGPA, however, continues to be superior to 
either predictor variable alone for predicting law school first-year average. 
These results support the validity of the LSAT for use in the law school 
admission process. (Author/SLD) 
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Executive Summary 

Since the Law School Admission Test (LSAT) was first administered, the sponsors of the test have 
carried out predictive validity studies to evaluate the effectiveness of the test as well as other predictors in 
determining first-year law school performance. Over the years, increasingly large numbers of law schools 
have participated in these studies, commonly called correlation studies. 

This report presents a summary of correlation study results for the 1995 and 1996 study years. This 
summary can serve as documentation of the generalizability of the claim of the validity of the LSAT for 
use in the law school admission process. More importantly, this study provides national longitudinal data 
for law schools to examine against their school-specific results to increase understanding of their own 
admission process. Since correlation studies are conducted for individual schools and school-specific 
results are reported only to the school whose data were analyzed, the results reported in this study may be 
used by schools as a benchmark in evaluating their own results. 

This report is largely a replication of an earlier study by Wightman (1993). The Wightman study, 
carried out for the 1990-1992 correlation study years, used scores reported on the 10-48 score scale. The 
current report, based on 165 law schools that participated in the correlation studies for both the 1995 and 
1996 study years, is the first report utilizing the 120-180 score scale, introduced in June 1991. 

The effectiveness of the LSAT score alone, undergraduate grade-point average (UGPA) alone, and the 
combination of these two variables for predicting first-year law school average (FYA) is evaluated. As 
previous studies have shown, results reported here indicate that the LSAT alone tends to be a better 
predictor of law school performance than is UGPA alone. The combination of LSAT and UGPA, 
however, continues to be superior to either predictor variable alone for predicting law school first-year 
average. These results support the validity of the LSAT for use in the law school admission process. 

Introduction 



For approximately 49 years, the sponsors of the Law School Admission Test (LSAT) have offered to 
conduct studies of the effectiveness of the test as well as other predictors of law school performance used 
in the admission process. These studies are offered free of charge to participating law schools, and schools 
have been encouraged to avail themselves of the service. Over the years, increasingly large numbers of law 
schools have participated in the LSAT correlation studies. During the two-year period from 1995 to 1996, 
183 different schools participated in the studies and 357 correlation studies were conducted. Among the 
183 schools, 165 schools participated for both years — 1995 and 1996. The summary data presented in this 
report are only from those 165 schools. 1 

One purpose of this study is to summarize data across schools to provide documentation of the 
generalizability of the claim of validity of the LSAT for use in the admission process. A more important 
purpose is to provide national longitudinal data for law schools to examine against their school-specific 
data to help them increase their understanding of their own admission process. Correlation studies are 
conducted for individual schools, and school-specific results are reported exclusively to the schools whose 
data were analyzed. Thus, schools know how well the test and other predictors are performing within their 
own admission process, but they have no benchmark against which to evaluate their results. 

The correlation studies provide valuable information to LSAT score users. One task frequently 
assigned to those responsible for law school admission is that of identifying from large groups of law 
school applicants those who are most likely to succeed in law school. A limited amount of information 




'Note that this report is largely a replication of an earlier national summary of the 1990-1992 correlation studies by Wightman (1993). The LSAT scores 
available at that time were from the 10-48 scale. The present report has been expanded to include correlations that have been statistically adjusted for 
restrictions of range. 
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usually is available from which to make that decision. Almost universally across all ABA-accredited law 
schools and English language common-law law schools in Canada, both LSAT score and undergraduate 
grade-point average are among the available data. Both are quantifiable measures that are potentially 
useful in making admission decisions and many schools use this information extensively. If this (or any 
other) quantifiable information is relied on in the selection process, the burden is on the score user to 
obtain evidence that there is a relationship between the quantified variables and the outcome of interest to 
the admission committee — usually success in law school. The correlation studies can provide that evidence 
for participating schools. An additional value of the correlation studies is that they provide score users with 
quantifiable information about how their admission process is working and about the makeup of their 
entering class. 

The Criterion Variable 

Academic success in law school is typically among the important outcomes that those responsible for 
admission would like to predict. To be sure, there exist other admission goals within individual law 
schools, but the LSAT purports to be useful for the limited purpose of predicting academic success, so a 
criterion related to academic success is the most appropriate one for validating the LSAT as a predictor. In 
the correlation studies, the variable used to represent academic success is first-year average (FYA) in law 
school. Using FYA as the criterion variable is not unique to LSAT validity studies. A variable based on 
first-year grades is the most typical criterion used to validate almost all admission tests. First-year average 
is not the only criterion that could be used, but it has several advantages that have shown it to be a useful 
criterion. First, it represents a composite of the academic performance of a student after a year of law 
school. Some of the courses taken may have been easier than others; some professors more lenient in 
grading than others. By using the average of all the grades received, these differences in course difficulty 
and grading stringency tend to average out. Second, for law students, the first-year grade-point average 
tends to represent basically the same curriculum for all of the students in the school. In subsequent years, 
different elective choices are represented in the composite average. Last, FYA data are available within a 
year, while other criteria might require a delay of two, three, or more years before a study can be 
conducted. 

The Predictor Variables 

Two predictor variables are used in the LSAT Correlation Studies: undergraduate grade-point average 
(UGPA) and LSAT score. Individual schools may use other predictors in their admission process, but these 
two are available for every school. The UGPA used in the correlation studies is the same as the UGPA that 
the Law School Admission Council provided to the law school from the Law School Data Assembly 
Service (LSDAS), and thus is the UGPA that was available to the law school at the time the admission 
decision was made. The undergraduate grade-point average is computed by the LSDAS, according to 
LSDAS procedures. Grades computed in this manner are expressed on a scale of 0.00 to 4.33. 

LSAT scores available for the correlation studies reported in this study are all on the 120-180 LSAT 
score scale that was introduced in June 1991. The scores used in this study reflect an average of the three 
most recent LSAT scores. The 1995 studies were the first to be based on three years of data for LSAT 
scores on the 120-180 score scale. 

The 1995 studies report data for the 1992, 1993, and 1994 fall entering classes, as available. The 1996 
studies report data for the 1993, 1994, and 1995 fall entering classes. Data accumulated over three years 
provide more stable parameter estimates because a small number of outliers have less influence on 
prediction weights when the sample sizes are larger. This is particularly important for schools that use the 
compensatory admission model discussed later in this report. When schools allow a high test score to 
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compensate for a low UGPA or vice versa, the range restriction in LSAT score or UGPA can change 
dramatically from year to year, particularly when the size of the school is relatively small. Fluctuation in 
range restriction causes fluctuation over time in the estimates of the raw regression weights. Aggregating 
data helps stabilize the weights. 

Estimating Validity 

The general concept of validity is a broad one, encompassing the accumulation of data to support a 
particular use of a test. The particular type of evidence obtained from the correlation studies is referred to 
as predictive validity. This is so because law school applicants' first-year law school grade-point averages 
are predicted from their LSAT scores and undergraduate grade-point averages. The statistical procedure 
used in these studies to predict law school performance from one or both of the prediction variables is 
linear regression. When a single predictor is used to predict the criterion, the prediction equation can be 
represented by a straight line on a graph that shows for every student a single point that represents both 
score on the predictor variable (e.g., LSAT score) and criterion score (e.g., FYA). The exact position of the 
line on the graph is calculated so as to minimize the (squared) distance of every point from the line. A 
statistic known as the correlation coefficient provides an estimate of how well the line represents the points 
on the graph. The correlation coefficient varies from 0, indicating no relationship, to 1, indicating a perfect 
linear relationship. When the correlation coefficients are high, the points are close to the prediction line; 
when the coefficient is close to zero, there is little relationship between the points and the line. The closer 
the points are to the regression line (or the higher the correlation coefficient), the more accurately the 
predictor predicts the criterion. Figures 1 and 2 show two examples of prediction lines and the relative 
positions of data points for some sample law school data. In Figure 1, LSAT score is the predictor, FYA is 
the criterion, and the correlation coefficient is .62. In Figure 2, LSAT score and FYA are again the 
predictor and criterion variables, and the correlation coefficient is .01. The figures are provided as an 
illustration of the relative accuracy of different sized correlation coefficients. 



FIGURE 1. Best regression line for LSAT/FY A data , r = 0.62. 
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FIGURE 2. Best regression line for LSAT/FYA data, r - 0.01. 
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Test-score users should not expect to find perfect correlations between test scores and the law school 
performance criterion. Many factors other than the acquired academic skills measured by the LSAT 
contribute to academic performance. In addition, there is a certain amount of measurement error inherent 
in the test. When test scores and UGPAs are factors that influence the admission process, the range among 
admitted students becomes restricted relative to the applicant pool. The issue of restricted range draws our 
attention to the behavior of both the selected and unselected groups. The selected group is the students for 
each school that have been admitted and have a first-year average. This group tends to be more 
homogeneous than the entire applicant pool. The selected group also tends to observe less variance in both 
predictor variables. The unselected population of students for each school is the group that applied to a 
particular school during the relevant application years. Not all of these individuals have a FYA, since not 
all of these people were granted admittance to a particular school. A common observation of higher 
validity coefficients with the unselected group will also be examined in this report. 

Further, because the UGPA is influenced by factors such as the leniency of the graders, the rigor of the 
curriculum represented by the grades, and the students' motivation and application, UGPA also should not 
be expected to be a perfect predictor. In fact, experience shows UGPA alone typically to be a fairly poor 
predictor of later academic achievement. 



Results 



Summary Data 

Descriptive statistics for schools participating in the correlation studies for both of the years 1995 and 
1996 are presented in Table 1. These data confirm that the average sample size for each correlation study is 
quite large. The size of the samples is primarily a consequence of including the most recent three years of 
student data in the study when it is available. Three years of data are not always available and all of the 
studies included in this report do not include three years of accumulated data. Schools participating for the 
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first time may only be able to provide data for one year. More commonly, the correlation study is based on 
a single year of data when a school introduces a grading-scale change. Eleven of the schools included in 
this summary introduced a grade-scale change during one of the three study years. As evidenced by the 
minimum sample size of 82, even when only one year of data is available for analysis, the sample sizes are 
large enough to produce stable least-square regression results. The advantage gained from using three 
years of data is found in the stability of the weights applied to the two predictor variables rather than in the 
magnitude of the correlation coefficients. The data in Table 1 show that both the mean and median LSAT 
of enrolled students decreased slightly from 1995 to 1996. During the same time period, the mean and 
median UGPAs were very similar. The range of average LSAT scores across schools is fairly substantial, 
varying from a low mean of 135.93 to a high mean of 168.59 for the 1995-96 entering classes. The size of 
the range is approximately equal for the 1994-95 entering classes. The range and variance of mean LSAT 
scores reported in Table 1 suggests that the differing characteristics of law schools are well represented in 
this report. 

TABLE 1 



Descriptive statistics for 165 schools participating in the LSAT correlation studies for 1995 
and 1996 



Variable 


Statistic 


1995 


Studv Period 

1996 


Sample Size 


Mean 


519.40 


556.11 


Standard Deviation 
Range 


236.88 


250.97 




Minimum 


82 


122 




Maximum 

Percentiles 


1,373 


1,470 




25th 


374 


398 




50th (median) 


467 


509 




75th 


634 


667 


LSAT 


Mean 


156.18 


155.81 




Standard Deviation 
Range 


4.82 


4.91 




Minimum 


136.24 


135.93 




Maximum 

Percentiles 


168.18 


168.59 




25th 


153.58 


153.08 




50th (median) 


156.09 


155.65 




75th 


158.89 


158.63 


UGPA 


Mean 


3.21 


3.21 




Standard Deviation 
Range 


0.19 


0.19 




Minimum 


2.63 


2.65 




Maximum 

Percentiles 


3.66 


3.67 




25th 


3.11 


3.10 




50th (median) 


3.21 


3.20 




75th 


3.33 


3.34 



Correlation Coefficients 



As discussed earlier, the correlation between predictor and criterion provides an indication of the 
usefulness of the predictor(s). The correlations presented in Table 2 show that for each of the study years, 
the LSAT score is a substantially better predictor of first-year performance in law school than is the 
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undergraduate grade point average. The data also show that the combination of LSAT and UGPA provides 
better prediction than either predictor alone. These results are consistent with findings from earlier LSAT 
validity summary reports (e.g., Evans 1982; Schrader 1976; Wightman 1993). 

TABLE 2 

Summary correlations between and among predictor and criterion variables for law schools participating 
in 1995-1996 conflation studies : selected^ first-year^ student results 

Standard 



Variables 


Year 


Mean 


Deviation 


25 


50 


75 


Minimum 


Maximum 


Zero Order Correlations 
















LSAT/FYA 


1995 


0.40 


0.10 


0.35 


0.42 


0.47 


0.02 


0.61 




1996 


0.40 


0.09 


0.34 


0.40 


0.46 


0.01 


0.62 


UGPA/FYA 


1995 


0.26 


0.08 


0.20 


0.27 


0.31 


0.05 


0.45 




1996 


0.25 


0.08 


0.19 


0.25 


0.31 


0.02 


0.41 


LSAT/UGPA 


1995 


-0.05 


0.14 


-0.13 


-0.05 


0.06 


-0.44 


0.31 




1996 


-0.06 


0.13 


-0.15 


-0.06 


0.04 


-0.46 


0.24 


Multiple Correlations 
















LSAT & 


1995 


0.49 


0.08 


0.44 


0.50 


0.55 


0.18 


0.68 


UGPA/FYA 


1996 


0.48 


0.08 


0.44 


0.49 


0.53 


0.11 


0.68 



The size of the mean correlation coefficients is virtually identical for both years. This consistency is 
attributable partly to the amount of overlap in the data resulting from the accumulation of three years of 
data for each study by most participating schools. The size of the correlations between LSAT and FYA, 
and between UGPA and FYA are consistent with those reported by Wightman (1993) for the 1990 through 
1992 LSAT correlations studies. That is, Wightman reported median validity coefficients (correlations) of 
.41, .41, and .42 for LSAT for each year, and of .25, .26, and .26 for UGPA for 1990, 1991, and 1992, 
respectively. 

Stem and leaf plots provide a graphical illustration of the correlation coefficients reported in Table 2. 
Six separate stem and leaf plots are provided in Figures 3 and 4. Separate plots are provided for each of the 
predictor combinations of LSAT and UGPA combined, LSAT alone, and UGPA alone, in that order, 
across each row. Figures 3 and 4 show the separate distributions for the years 1995 and 1996, respectively. 
The stem (the left column of each plot) is the first digit of the correlation coefficient. The leaf (the row of 
numbers separated from the stem by a single space) shows the second digit of the correlation coefficient 
for each school that produced a correlation coefficient in the group defined by the stem. For example, 
looking at the 1995 data (Figure 3), in the stem group between .60 and .64 on the plot of correlation ’ 
coefficients resulting from the combined LSAT and UGPA predictors, nine schools had correlation 
coefficients of .60. Thus, nine zeros are printed in the row across from the 6. Likewise, the one 1 represents 
the school that had a correlation coefficient of .61, and the one 2 represents the school that had a 
coefficient of .62. Notice that there are two rows that begin with a six. The leaves in one row range from 
.60 to .64; the leaves in the other row range from .65 to .69. This pattern holds for every pair of rows in the 
figures. The right-hand column of each plot shows the number of schools represented in each stem and leaf 
(row) of the plot. If the stem and leaf plot is rotated 90°, it can be viewed as a histogram of the distribution 
of correlation coefficients. Examination of the stem and leaf plots reveals that the coefficients are not 
widely variable across schools and the histograms are very peaked. Looking across the three plots within a 
single year affords an informative picture of the usefulness of the different predictors in providing 
information about first-year performance in law school. The correlation coefficients derived from the 
combined predictors are concentrated at the highest section of the plot because the combined predictors 
O 
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produce the highest correlation with first-year average. Moving from top to bottom on the page, the 
concentration of correlation coefficients steps down the stem axis, indicating slightly lower correlations 
resulting from using LSAT alone, and considerably lower correlations using UGPA alone. The step-down 
pattern is consistent across each of the two years of studies, and, of course, is consistent with the summary 
data reported in Table 2. 

An individual school might find it of interest to locate its own correlation coefficient on each of the 
three stem and leaf plots for the relevant study year. By marking or circling their own coefficient, the 
school will have an indication of how well the predictor or combined predictors are working for them 
relative to other law schools. This information needs to be evaluated in context with other pertinent 
information, particularly the variability of the predictors) in the entering class(es) upon which the analyses 
are based and the correlation between LSAT and UGPA for members of the analysis class. The impact of 
each of these factors is discussed in later sections of this report. 
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Variable = LSAT and UGPA combined 
Stem Leaf # 

6 58 2 

6000000000123334 15 

5 5555556666667777788888889 25 

5 000000000 11111111 1222222222222222333333444444 45 

4 5555556666777777777778888888888999 34 

40000111111222222333344444 25 

3 557777778899 12 

3 00333 5 

2 

20 1 

18 , 

1 

0 

0 



Variable = LSAT alone 

Stem Leaf # 

6 

6 01 2 

5 5599 ' 4 

5 000000001 1 1 1 1 12222233334444 27 

4 55556666666777888999 20 

4 001 1 1 1 1 1 1 1 12222222222222223333333444444444 42 

3 5556666666666677778888888889999 31 

3000000111122222334444 21 

2 55567899 8 

2 1334444 7 

1 6 1 

10 1 

0 

02 1 

Variable = UGPA alone 

Stem Leaf # 



6 

6 

5 

5 



4 022234 6 

3 55555666666778 14 

3 0000000001 1 1 1 12222222333334444444 33 

2 55555666677777777788888888899999999999 38 

2 000000001 1 1 1 1 11222233334444444444 33 

1 5555666777778888899999999 25 

1 00011222444 „H 

0 5689 4 

_0 

Note . Multiply Stem. Leaf by 0.1 



FIGURE 3. S/em am/ leaf plots for prediction of FYA from LSAT 
score and UGPA in combination and alone, 1995 data. 
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Variable = LSAT and UGPA combined 
Stem Leaf # 

6 78 2 

6 0011123334 10 

5555566666666677777888 21 

5 0000000011 1 1 1 1 1222222222222333333333444444 42 

4 555555555666666677777777888888888999999999999 45 

40000001111222223344444444 25 

3 555556678889999 15 

3 334 3 

28 1 

2 

1 

1 1 1 

0 
0 

Variable = LSAT alone 

Stem Leaf # 

6 

62 1 

5 556889 6 

5 0000011112234 13 

4 5555556666666666777778889999999 31 

4 0000000001 1111111 12222222222333444444444 40 

3 55555556666777788888888999999 29 

3 0000001 1 1 1 1 122233333444444 26 

2 6678888889 10 

2 223444 6 

1 9 1 

1 

0 

0 14 2 

Variable = UGPA alone 

Stem Leaf # 



6 

6 

5 

5 

4 



4 0001 4 

3 55556777777889 14 

3 000000001 1111111 12222222333334444444 36 

2 55555566666666777777888888999999 32 

2 00001 1 1 122222222222222233333334444444 37 

1 556666677777788888888899999 27 

1 00133334444 . .. - ...... n 

0 688 3 

02 1 

Note. Multiply Stem. Leaf by 0 I 




FIGURE 4. Stem and leaf plots for prediction of FYA from LSAT score 
and UGPA in combination and alone, 1996 data. 
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Factors Influencing the Magnitude of the Correlation Coefficients 

The correlation coefficients reported in Table 2 most likely are an underestimate of the true validity of 
the test. That is, the correlations are based on LSAT scores, UGPAs, and FYAs only for those students who 
were accepted to and attended the studied law school. Most applicants with low test scores and low 
UGPAs are not admitted and thus there are no first-year grades for them. As a consequence, they cannot be 
included in the study. Because there is less variability in the scores of admitted students than in the scores 
of all applicants, correlations are smaller than they would have been had the class been admitted randomly 
from the total applicant pool. Thus, correlations obtained from matriculated students only tend to 
underestimate the true validity of the test. Even so, they are the best information that we have available, 
and even as underestimates they are quite reputable. 

Table 3 presents estimated and actual correlation coefficients for the unselected population of 
applicants. As expected, the validity coefficients are consistently higher for the uuselected group than they 
are for the selected group represented in table 2. For example, when comparing the selected and unselected 
groups in the 1995 and 1996 study years, the validity coefficients for LSAT/FYA increased 0.12 in both 
cases. For both study years, the minimum and maximum values of the correlation coefficients for each 
combination of variables tend to be stable. For example, in 1995 the range of the correlation coefficient for 
UGPA/FYA was 0.07 to 0.60. In 1 996, the range was 0.03 to 0.58. For each combination of variables, the 
mean and median values of the validity coefficients tend to be similar. In 1995, a mean correlation 
coefficient of 0.26 was observed and a median of 0.26 was observed for LSAT/UGPA. In 1996, a mean 
correlation coefficient of 0.25 was observed and a median of 0.25 was observed. 

TABLE 3 

Summary correlations between and among predictor and criterion variables for law schools 
participating in 1995-1996 correlation studies: unselected results 



Standard 



Variables 


Year 


Mean 


Deviation 


25 


50 


75 


Minimum 


Maximum 


LSAT/FYA* 


1995 


0.52 


0.10 


0.46 


0.53 


0.59 


0.03 


0.73 


1996 


0.52 


0.10 


0.47 


0.52 


0.58 


0.02 


0.74 


UGPA/FYA* 


1995 


0.30 


0.10 


0.22 


0.30 


0.35 


0.07 


0.60 


1996 


0.29 


0.09 


0.22 


0.29 


0.34 


0.03 


0.58 


LSAT/UGPA** 


1995 


0.26 


0.09 


0.20 


0.26 


0.31 


0.02 


0.47 


1996 


0.25 


0.09 


0.20 


0.25 


0.31 


-0.01 


0.46 



* Adjusted for restriction of range 
**Based on all applicants 



In addition to the problem of reduced variability, matriculated students include some who are admitted 
as a result of special consideration. That is, some students with low test scores or low UGPAs are admitted 
to law school, but usually they are not typical of the low-scoring applicants who are rejected. Instead, they 
are admitted because the school has some other evidence of their ability to do well in law school. This 
practice frequently is referred to as a compensatory admission model. For example, a compensatory model 
allows a high LSAT score to compensate for a low UGPA and conversely, a high UGPA to compensate for 
a low LSAT score when making admission decisions. One way to determine whether a compensatory 
model for LSAT scores and UGPAs is in place in a particular law school is to look at the correlation 
between LSAT score and UGPA. In a random group of applicants, this correlation would be fairly high, 
indicating that applicants with high LSAT scores also had high UGPAs, while applicants with low LSAT 
scores also had low UGPAs. When a compensatory model is used, the correlation between LSAT and 
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UGPA frequently is negative because a large number of students with high LSAT scores have low UGPAs 
and vice versa. 

The correlations between the LSAT and UGPA reported in Table 2 are close to zero. Across the two 
years, the correlations range from -.46 to .31, suggesting that a substantial number of law schools are to 
some degree employing a compensatory admission model. The data presented in Table 4 show the effect of 
employing a compensatory model on the estimates of the validity coefficients. Schools that rely heavily on 
a compensatory model tend to have negative correlations between LSAT and UGPA and are represented in 
the rows labeled “Less than 0” in Table 4. Over half of the schools fell into this category for each of the 
years reported. The data show that the correlations for either predictor alone as well as for the two 
predictors combined are consistently higher for schools where the correlation between LSAT and UGPA is 
positive. For example, looking at the 1 996 correlation study data, the average correlation between LSAT 
and FYA is .36 for schools that have a negative correlation between LSAT and UGPA, but it increases to 
.53 for schools that show a positive correlation greater than .2 between those variables. A similar pattern 
exists for UGPA alone and for LSAT and UGPA combined. The pattern is evidenced across each of the 
three years. 

TABLE 4 



Average correlations of LSAT scores and UGPA with FYA in law schools grouped by the correlation 
between LSAT score and UGPA 



Year 


Correlation of LSAT with UGPA 


Predictor Variables 




LSAT & UGPA 
Combined 


LSAT 

Alone 


UGPA 

Alone 


1995 


Less than 0 


0.46 


0.37 


0.22 




(number of schools) 


(103) 


(103) 


(103) 




0.0 to 0.2 


0.53 


0.46 


0.31 




(number of schools) 


(57) 


(57) 


(57) 




Greater than 0.2 


0.60 


0.54 


0.38 




(number of schools) 


( 5 ) 


( 5 ) 


( 5 ) 


1996 


Less than 0 


0.46 


0.36 


0.22 




(number of schools) 


(105) 


(105) 


(105) 




0.0 to 0.2 


0.53 


0.45 


0.30 




(number of schools) 


(56) 


(56) 


(56) 




Greater than 0.2 


0.59 


0.53 


0.37 




(number of schools) 


( 4 ) 


( 4 ) 


( 4 ) 



One observation of note from the data presented in Table 2 is that the range of correlation coefficients 
for any of the prediction models varies substantially from law school to law school. For example, the 
correlations between LSAT and FYA vary from a low of .01 to a high of .62. The cause for this amount of 
variation in what might be expected to be a stable environment was studied extensively by Linn (e.g., Linn, 
1982; Linn, Hamish, & Dunbar, 1981). In analyzing the validity summary data reported by Schrader 
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(1976), Linn determined that as much as 34% of the variance in observed validities could be predicted 
from observed standard deviations and variances of the LSAT. That is, the larger the variation (range) in 
the predictor, the higher the correlation with the criterion. Because so much variation is observed in the 
correlation coefficients for the validity studies summarized in this report, Linn's procedures were replicated 
using the 1995-96 correlation study data. The multiple correlations between the observed validities and the 
LSAT standard deviation and its square (the variance) were calculated for each study year. Similarly, the 
same calculations were made using UGPA standard deviation and its square and the combined LSAT and 
UGPA standard deviations and squares. The results are presented in Table 5. The amount of variance in 
observed validities predicted by the LSAT and its square is slightly higher than was reported by Linn. For 
the 1995 data, 41% of the variance (0.64 2 ) is accounted for, although 35% from 1996 is closer to Linn's 
result. For both the LSAT alone and for the LSAT and UGPA combined, there is a substantial relationship 
between variability among validity coefficients across law schools and variability in the predictors within 
law schools. In contrast, the variance in UGPA accounts for approximately 4% of the variance in the 
UGPA validity coefficients. Even so, the relationship between validity and UGPA variability is larger than 
the .05 correlation reported by Linn and Hastings (1983). 

TABLE 5 



Multiple correlations of validity coefficients with standard 
deviations and squared standard deviations of predictor variables 







Predictor 




Year 


LSAT 

Alone 


UGPA 

Alone 


LSAT & UGPA 
Combined 


1995 


0.64 


0.17 


0.64 


1996 


0.59 


0.20 


0.58 



Cross Validation Studies 

A primary purpose for conducting validity studies for most schools is to obtain the best possible 
prediction weights so that they can be applied to the application credentials of the next year's applicant 
pool to aid in the decision process. That is, data from past experience are used to make future predictions. 
When the results from the correlation studies are being used in this way, the most relevant question to ask 
is how well do the equations from previous first-year classes predict the performance of future first-year 
classes. To answer this question, several cross validation studies were conducted. Specifically, the 
prediction equations calculated from the 1995 correlation studies (i.e., the 1994-95 first-year class data) 
were used to predict a first-year average for each member of the 1995-96 first-year class. Then, the 
correlation between the predicted FYA and the actual FYA earned by the members of the 1995-96 class 
was calculated. These calculations were performed separately for each school, using each school's unique 
least-squares prediction model. The results from these cross validations are presented in Table 6. The 
results from these analyses are nearly identical to the correlation coefficients reported in Table 2. When the 
equations from the immediately preceding year are used to predict FYA, the correlation between predicted 
and actual FYA exceeds .4 for more than 75% of the schools. These results are consistent with those 
reported by Evans (1982) for the 1977-79 studies, when 73, 74, and 82%, respectively, of the schools 
exceeded the correlation coefficient value of .4. The 1995-96 results are slightly lower than those reported 
by Wightman (1993) for the 1990-92 studies when 86% of the schools exceeded the correlation coefficient 
of .4. 
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TABLE 6 

Cross validated multiple correlations for 1995 prediction 



equations using 1996 class data 



Correlations Between Actual 
FYA and Predicted FYA 


1995 Equations 

1996 Class Data 


Mean 


0.47 


Standard Deviation 


0.12 


Range 


Minimum 


-0.02 


Maximum 


0.68 


Percentiles 


25th 


0.40 


50th 


0.48 


75th 


0.55 


Percentage GT .4 


75.00 



Accounting for Variance 

The data in Table 2 show that the best model for predicting FYA is consistently the model that 
combines LSAT and UGPA, where best model is defined as the model that provides the highest correlation 
between the predictors and the criterion. On average, the LSAT accounts for more of the variance 
predicted by the model than does UGPA, although there are some schools for which this is not the case. As 
shown in Table 7, the mean variance accounted for by LSAT is approximately 60% and, thus, the mean 
variance accounted for by UGPA is approximately 40%. Another way of interpreting the percentage of 
variance accounted for is in terms of the relative weights of the two predictors. That is, the LSAT is 
weighted 60% and the UGPA 40% on average in order to obtain optimal prediction of FYA. The percent of 
variance accounted for by LSAT and by UGPA can vary considerably for individual schools. The 
variability of LSAT scores and UGPA, the correlation between UGPA and LSAT, and the amount of 
variability in the first-year averages all influence the amount of variance that will be accounted for by the 
two predictor variables in the model that provides optimal prediction of FYA. 



TABLE 7 



Summary of percentage of variance accounted for by predictor variables in multiple regression 
prediction equations 



Variable 


Year 


Mean 




Range 


Percentiles 


Standard 

Deviation 


Minimum 


Maximum 


25 


50 


75 


LSAT 


1995 


60.56 


7.61 


18.76 


77.10 


56.36 


61.19 


64.80 




1996 


60.13 


7.42 


18.89 


73.10 


56.57 


60.61 


65.62 


UGPA 


1995 


39.44 


7.61 


22.90 


81.24 


35.20 


38.81 


43.64 




1996 


39.87 


7.42 


26.90 


81.11 


34.38 


39.39 


43.43 



ERjt 



17 



14 



Trends Over Time 

The data presented in Tables 2 through 7 suggest that the results from the validity studies conducted 
for each of the 165 law schools that participated in the two most recent study cycles are very consistent 
from year to year. Data to look more specifically at data consistency across years are presented in Table 8. 
The average difference between validity coefficients of studies conducted for 1995 and 1996 is very close 
to zero. Additionally, the distribution of differences is fairly tight, as evidenced by the difference values 
that mark the 25th and 75th percentiles. Again, these results are somewhat influenced by the inclusion of 
three years of data. For each subsequent year, the oldest data year is dropped and the most recent is added. 
Although this data design will minimize the influence of individual anomalies, systematic shifts in the data 
over time would be evidenced should they occur. The data reported in this study do not indicate changes in 
the validity of either predictor alone or in the combined predictors for the national data reported for the 
years 1995 and 1996. 



TABLE 8 

Average size ofyear difference s in validity coefficients by type o/ prediction model 



Years 


Differences 


LSAT & UGPA 
Combined 


LSAT 

Alone 


UGPA 

Alone 


1995-96 


Mean 


0.01 


0.01 


0.00 




Standard Deviation 
Percentiles 


0.04 


0.05 


0.04 




25th 


-0.02 


-0.02 


-0.02 




50th 


0.01 


0.01 


0.01 




75th 


0.03 


0.04 


0.03 



Conclusion 

This two-year national summary of the LSAT correlation studies conducted in the years 1995 and 1996 
lends continued support for the validity of the LSAT in the law school admission process. Major findings 
from this study are summarized as follows: 

• The combination of LSAT and UGPA are useful predictors of academic performance in the first 
year of law school. The average multiple correlation between first-year grades in law school and the 
combined predictors of LSAT and UGPA of .49 and .48 for years 1995 and 1996, respectively, is 
high and consistent with that reported previously. As has always been the case, these combined 
predictors continue to be superior to either predictor alone for predicting first-year average. 

• LSAT alone continues to be a better predictor of law school performance than is UGPA alone. The 
median validity coefficient for LSAT alone is .41, compared with .26 for UGPA alone. 

• When schools are grouped by the correlation between LSAT and UGPA, the validity coefficients 
increase when the correlations between the predictors increase. This relationship provides some 
indication of the impact of the restriction of range resulting from using only matriculated students 
on the estimates of validity, particularly in the presence of a compensatory admissions model. 

• A substantial amount of the variability in validity coefficients obtained among different law schools 
is directly attributable to the amount of variation in LSAT scores and UGPAs in the data used to 
estimate the validity. 

• Cross-validation studies support the use of regression equations based on previous first-year classes 
to predict future performance of law school applicants. 

0 
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An additional important outcome of the current study is that the data show no deterioration in the 
validity of the LSAT as a predictor of first-year performance in law school. This has been shown since the 
conduct of the validity summary study by Evans (1982) that looked at results from correlation studies 
carried out in 1977 through 1979. During this time, the UGPA also has shown no change in its predictive 
power. Thus, the relative importance of the two remains essentially unchanged. 
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